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FIELD 

The invention relates to a method and apparatus for predicting the result of coloration of 
a substrate by a coloring product. The method and apparatus are especially suitable for quickly 
and easily determining the result of a cosmetic coloration of a substrate such as hair, skin or nail 
10 by a commercial product. 

BACKGROUND 

Bleaching and coloring (or dyeing) of hair has become increasingly popular over the past 
years. Younger people may want to change the natural color of their hair to a more fashionable 
one, while older people may also use dyeing products to conceal gray hair. As a result there is an 
1 5 extremely large choice of available products for consumers to choose from. Often, the individual 
consumers find it difficult to determine which hair coloring product to choose to achieve their 
desired color. 

Hair coloring products may be sold in packages displaying a coloring chart with three or 
more starting colors and three or more corresponding resulting colors. However, consumers have 
20 difficulties identifying which of the starting colors best matches their starting hair color and more 
choice of starting colors is desirable for a more accurate result. Furthermore consumers often do 
not trust the accuracy of the printed color chart on the carton. 

Complicated systems have been designed in the past wherein the consumer inputs 
information about the starting color of his/her hair and the desired color, the system then 
25 matching this information with a commercial product that will provide the desired result. These 
systems can be implemented on a computer or via mechanical means such as cooperating wheels. 

For example EP290327 discloses an apparatus for selecting a coloring product capable of 
achieving a desired hair color. The apparatus comprises a micro-processing unit, a memory bank 
relating to available coloring products, a keyboard for inputting information about the starting 
30 and the desired color into the micro-processing unit, and a printer connected to the micro- 
processing unit. The micro-processing unit is programmed to predict from the inputted 
information a suitable coloring product, whose reference is then printed on paper. 

EPl 147722 discloses a hair color advice system comprising a digital camera for taking a 
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picture of a subject, a computer processing means and a computer screen. The computer 
processing means is programmed to analyze the picture taken, distinguish the hair area in the 
picture and electronically change the color of the hair area to a new color. The modified picture is 
displayed on the computer screen and, if the subject is satisfied by the displayed color, the 
5 processing means is used to predict a coloring product suitable for providing the desired color to 
the subject's hair. 

US4,434,467 discloses a device for determining the hair coloring products to be used to 
change a subject's initial hair color to a desired hair color comprising an electronic data 
processing system. 

10 WOO 1/87245 discloses a system for recommending a hair coloring product, said system 

comprising a colorimeter or spectrophotometer for analyzing the initial hair color of a subject and 
a computer system implemented with a color prediction model. The system is capable of 
identifying at least one achievable end hair color based upon said initial hair color and optionally 
other parameters such as hair damage, and is also capable of recommending a suitable coloring 

1 5 product for achieving any of the achievable hair color upon request from the subject. 

EP 1,240,845 discloses an apparatus for providing personalized advice regarding hair 
coloring. 

It has now been found that consumers were often confused by the large choice of coloring 
products available in store and that selecting and trying a new coloring product is a stressful and 

20 sometimes disappointing experience. Consumers will often pick a coloring product on a shelf, 
spend a few minutes reading the information printed on the package to eventually put it back as 
the information displayed will leave them in doubt as to the result the product will give on their 
hair. Furthermore, consumers are often disappointed by the result of hair coloring and need to try 
several different products (typically 3-4) before finding a product providing their desired final 

25 hair color. There is therefore a need for a method of quickly and simply predicting the result of a 
coloration of a substrate such as hair by a specific coloring product. 

SUMMARY 

The present invention is directed to a method and apparatus for quickly and simply 
predicting the result of the coloration of a substrate (e.g. hair) by a specific coloring product (e.g. 
30 hair dye). The method comprises the steps of inputting information relating to the coloring 
product in a micro-processing system, inputting information relating to the initial color of the 
substrate in the micro-processing system, predicting from the input information a likely result of 
the coloration of the substrate, and displaying the likely result. 
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The method may comprise the further steps of inputting information relating to a desired 
color different from the result displayed in the predicting system, predicting at least one coloring 
product capable of providing the desired color to the substrate, and displaying information about 
the at least one coloring product capable of providing the desired color. 
5 The methods according to the present invention may be implemented on an apparatus 

comprising a micro-processing system, means for inputting information relating to the coloring 
product in the micro-processing system, means for inputting information relating to the initial 
color of the substrate in the micro-processing system, wherein the micro-processing system is 
capable of predicting from the input information a likely result of the coloration of the substrate 
10 by the coloring product, and means for displaying the likely result of the coloration as predicted 
by the micro-processing system. 

The method and apparatus according to the present invention may be used at the point of 
purchase of coloring products, for example department stores, drug stores, mass markets, 
groceries or virtual supermarkets accessible on the Internet. The user of the method and device 
1 5 may be the consumer of the product, a beauty advisor (e.g. in a salon) or another person. 

These and other features, aspects, and advantages of the present invention will become 
evident to those skilled in the art from a reading of the present disclosure. 

Brief Description of the Figures 

While the specification concludes with claims which particularly point out and distinctly 
20 claim the invention, it is believed the present invention will be better understood from the 
following description of preferred embodiments taken in conjunction with the accompanying 
drawings, in which like reference numerals identify identical elements and in which: 

Fig.l is a block diagram 100 of an embodiment of a method according to the present 
invention; 

25 Fig.2 is a screen shot of a welcoming screen which may be used in block 110 within 

Fig.l; 

Fig.3 is a screen shot of an input screen which may be used in block 130 within Fig.l; 

Fig.4 is a screen shot of an input screen which may be used in block 140 within Fig.l; 

Fig.5 is a screen shot of a display screen which may be used in block 150; 
30 Fig.6 is a screen shot of a result display and input screen which may be used in block 160 

and blocks 180-200 within Fig.l; 

Fig.7 is a screen shot of a close-out screen which may be used in block 170 and block 210 
within fig.l; 
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Fig.8 is a perspective view of an embodiment of an apparatus according the present 
invention; 

Fig.9 is a frontal view of the embodiment of Fig.8; 
Fig. 10 is a side view from the right of the embodiment of Fig.8; 
5 Fig. 1 1 is a side view from the left of the embodiment of Fig.8; 

Fig. 12 is a top view of the embodiment of Fig.8. 

Detailed description of the preferred embodiments 

All cited references are incorporated herein by reference in their entireties. Citation of 
any reference is not an admission regarding any determination as to its availability as prior art to 

1 0 the claimed invention. 

Herein, "comprising" means that other steps and elements can be added. This term 
encompasses the terms "consisting of and "consisting essentially of*. The methods/processes 
and apparatuses of the present invention can comprise, consist of, and consist essentially of the 
essential elements and limitations of the invention described herein, as well as any of the 

1 5 additional or optional steps, elements or limitations described herein. 

The methods and apparatus according to the present invention may be used for quickly 
and simply predicting the result of the coloration of any type of substrates with any type of 
coloring products, and is especially suited for being used for predicting the result of the 
coloration of human hair with hair dye products. Several brands coexist on the hair dye markets, 

20 and each brand may encompass dozens of different products. The methods and apparatus 
according to the present invention are especially useful in department stores where a large choice 
of different hair dye products is available. However, the methods and apparatus may be used 
anywhere without departing from the scope and spirit of the present invention, for example in a 
salon. Examples of other coloring products that may be used include nail varnishes, lipsticks, 

25 foundations, mascaras and blushers. 

An embodiment of the method of the present invention is illustrated in block diagram 100 
of Fig.l. This method may be embodied in the apparatus 2 described in Fig.8 - 12, which 
comprises a base 4, a computer screen 6 and mirror 8 both mounted on a adjustable support 10 
which can pivot relatively to the base 4, a tray 12 fixed to the base 4 and equipped with a bar 

30 code scanning device (not represented). The apparatus also comprises a micro-processing system 
(not represented) connected to the bar code scanning-device and computer screen 6. The micro- 
processing system may be installed inside the base 4. The computer screen 6 may be a 
conventional or interactive ("touch-screen") screen, such as a cathode ray tube (CRT) computer 
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screen, a plasma screen, a liquid crystals screen or any other type of screen that may be connected 
to the micro-processing system. The computer screen should be calibrated to accurately display 
colors, for example using the International Color Consortium (ICC) standard for screen 
calibration. 

5 Preferably the computer screen is of the interactive ("touch-screen") type, wherein 

information may be input into the micro-processing system by pressing sensitive areas of the 
screen. In a preferred embodiment as represented in Fig. 8- 12, a thin film transistor (TFT) 
interactive screen is used. The TFT interactive screen 6 is intended to give and receive 
information for the purpose of executing the method. Interactive screens have pressure sensitive 

10 areas on their surface that sends an electronic signal when touched. Other means for inputting 
information into the micro-processing system may be used. For example any electro-mechanical 
devices capable of transforming a movement or pressure into an electronic signal are suitable, 
such as light pens or stylus used with an adapted screen. If a conventional, non-interactive screen 
is used, another example of means for inputting information into the micro-processing system is 

1 5 one or more push buttons, for example situated on the front side of the base 4. 

The method 100 referred to in Fig.l comprises a series of blocks (or method steps) 110 to 
210. These blocks will now be described in detail. Referring to Fig.l, the method 100 begins with 
a block 1 10 containing a welcome screen. The welcome screen may be designed to attract the 
consumers, for example by displaying animated pictures or messages, or by being reactive to 

20 consumer's motion. The welcome screen may contain a reference to a specific coloring house, for 
example CLAIROL (RTM) and coloring families belonging to that coloring house (for example 
ULTRESS(RTM), NICE'N EASY(TM) as is illustrated in Fig.2. The welcome screen also 
preferably displays instructions explaining how the user may initiate the method and proceed to 
the next step. For example in a preferred embodiment, the user is prompted by the welcome 

25 screen to input information relating to the coloring product into the micro-processing system, and 
thereby proceeds to block 120, by placing a packaged coloring product on the transparent or 
semi-transparent tray 12, which is equipped with a bar-code scanning device. 

In a preferred embodiment, the bar-code scanning device automatically scans the bar- 
code displayed on the bottom of the package and electronically transmits this information to the 

30 micro-processing system. Bar-code scanning devices are known in the art and are available, for 
example, from Retec Europe Ltd, Letchworth, England. The micro-processing system comprises 
a digital database referencing all coloring products that may be used with the apparatus and 
matches the information transmitted by the scanner with the coloring product scaimed. If the 
database is unable to find a reference with the products scanned (for example because the product 
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belongs to a non-referenced brand or has not been referenced yet), an error message may be 
displayed on the screen 6 and the method is reinitialized to the welcome screen of block 110. If 
the micro-processing system matches the information transmitted by the scanner with a coloring 
product referenced in the database, then the user is brought to block 130 of the method 100. 
5 Although a bar-code scanning device is preferred for its simplicity and rapidity of use, other 
means for inputting information about the coloring product could be used (for example a list of 
products could be displayed on the screen 6 and selected by tuming and pressing buttons, or 
simply by pressing the area of a TFT interactive screen displaying the name of the coloring 
product). The bar-code and bar-code scanning device could also be replaced, for example, by a 
10 Radio Frequency Interference (RFI) chip (also called "intelligent" or "smart" label) and a RFI 
scanning device. 

Once the information relating to the product (which can be any coloring products, such as 
a hair dye or foundation) has been input, the computer screen may display a message prompting 
the user to input information relating to the type of coloration desired (for a hair product this may 

15 be gray coverage, root coverage or highlight, as illustrated in Fig.3), and/or information relating 
to the initial condition of the substrate, apart from its initial color (for e.g., if the substrate is hair, 
it may be previously colored, virgin (never colored) and/or damaged). This information may be 
later used by the micro-processing system to more accurately predict the resulting color of the 
coloration and/or predict a suitable product for the type of coloration desired. In a preferred 

20 embodiment, the user will touch the area of the screen displaying the type of coloration desired 
(for example covering gray / matching present color) and this information will be transmitted to 
the micro-processing system and stored in its memory. 

The information relating to initial color of the substrate is input into to the micro- 
processing system in the next step of the method (represented by block 140 in Fig.l). In a 

25 preferred embodiment, a message displayed on the screen will prompt the user to select a color 
from a predetermined set of colors and matching as closely as possible the initial color of the 
substrate. A pre-selection screen may be provided before this step, for example wherein a limited 
choice of category of colors (for hair color this may be Blonde, Brown/black or Red/Auburn) is 
proposed. With this pre-selection step, the micro-processing system may determine a reduced 

30 number of possible matching colors to display next, thereby helping the user to select the 
matching color more quickly. 

As illustrated on Fig.4, the matching color may be selected by pressing sensitive areas of 
the interactive screen 6. In a preferred embodiment, all predetermined colors are not 
simultaneously displayed as this may be detrimental to the readability of the screen. The 
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predetermined set of colors is preferably ordered within a list, according to a visually 
recognizable parameter, for example from lighter to darker. The tonal value (for hair this may be 
natural, blue ash, green ash, gold, copper, red and violet) or the combination of tonal value and 
lightness of the colors may also be used as a sorting parameter. In a preferred embodiment, a 
5 color may be represented by an image or picture of a substrate (e.g. a swatch of hair) having the 
corresponding color (or shade). One relatively large area of the screen may be reserved for the 
display of one color at a time (e.g. "Extra light blond" on Fig.4), and two smaller areas set on 
opposite sides of this large area are used to display colors immediately above and below the 
hierarchical level of the list (if available). With this system the user can quickly navigate in the 

10 list of predetermined colors and select the color matching best its initial color. As illustrated on 
Fig.4, the navigation in the list of predetermined colors may be effected by pressing pressure 
sensitive areas of the interactive screen representing arrows and displaying short messages such 
as "lighter" or "darker". In order to help the user to select the best matching possible shade, a 
mirror 8 may be situated near, e.g. on the side of, the area of the screen displaying the selectable 

15 color (see Fig.8). If the substrate is hair, this mirror may be used to reflect a swatch of the hair to 
be dyed, allowing the user to quickly compare this swatch with the color displayed on the screen 
and thereby quickly determining the predetermined color best matching the initial color of the 
substrate. In the case of user having gray hair, if the system is not adapted to allow the selection 
of a gray hair shade, an advice may be displayed recommending the user to select the hair color 

20 closest from the main/original color. 

When the user is satisfied that the color displayed matches as well as possible the initial 
color, a validation button (which may be represented on the interactive screen) may be pressed. 
Other means for inputting the information relating to the initial color of the substrate may be 
used, for example automatic capture and display of the users starting hair color using a digital or 

25 video camera, contact or non-contact spectrophotometer. Suitable colorimeter or 
spectrophotometer systems for taking hair color readings and inputting them in a computer 
system have been disclosed in WOOI/87245. Selecting a matching color from a predetermined 
list as described above is preferred as this method is relatively simple and does not necessitate 
expensive equipment such as a spectrophotometer. 

30 In the next method step, designated by block 150 in Fig.l, a suitably programmed micro- 

processing system predicts the likely result of the coloration from the infonnation that has been 
input (information relating to the initial color of the substrate, information relating to the coloring 
product and optionally information relating to the type of coloration desired and/or to the initial 
condition (other than its color) of the substrate to be colored). 
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To do so, the micro-processing system may comprise a database in the form of a matrix, 
one entry of the matrix being the information relating to the initial color of the substrate and the 
other entry being the information relating to the coloring composition. The values inside the 
matrix are filled with data obtained from previous experimental testing, for example data 
5 obtained by coloring hair of consumers recruited to participate in a colorant program at a salon. 
The initial starting color and the resulting color obtained after the coloration were recorded and 
each result input as one data of the matrix. If some values are missing to totally fill the matrix, 
these values may be generated using one or more models extrapolating the data obtained for 
similar conq)ositions with different hair dye products, or extrapolating data obtained for different 

10 compositions with similar hair dye products. If the user inputs information about a coloring 
product and an initial color for which there is no data available, an error message may be 
displayed (as illustrated on Fig.5) and another coloring product that has been tested with the 
initial color proposed to the user instead. Preferably however all products should have been tested 
with all predetermined initial hair colors that the user may select on the screen. As determined 

15 during the experimental testing, some products may be totally incompatible with some initial 
substrate colors, and this information may also be used in the later steps of the method (see 
description of block 180 below). Color prediction models may also be used instead or in 
combination with a matrix. Such color prediction models are described in WOO 1/87245. 

A personal computer (PC) or any other type of computers or micro-processing machines 

20 can be easily programmed with these matrixes and/or models and with a method for retrieving the 
data entered in the matrixes. Additional information that may have been input in block 130 may 
also be used in this stage in order to more precisely predict the likely result of the coloration. For 
example, if the coloration is used to conceal gray hair instead of just changing the hair color of 
virgin, non-gray hair, then another pre-determined matrix may be used by the micro-processing 

25 system for the prediction, or the data of the matrix used for "changing hair color" could be shifted 
by a pre-set value believed to be representative of the difference between the result obtained 
when the coloration is used to conceal gray hair and the result obtained with the same product for 
changing hair color. 

One suitable type of micro-processing system comprises a main or central processing unit 
30 (CPU) which is connected via suitable adapters to a main memory (e.g. Random Access Memory 
(RAM)), a mass data storage system such as an hard drive for saving the data programmed in the 
system, a computer readable medium reader such as CD-ROM and/or a floppy disk drive for 
loading the method steps in the form of a conq)uter program into the micro-processing system, 
the interactive screen 6 and optionally one or more other display means such as a printer. The 
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micro-processing system may also comprise a suitably connected network card that allows the 
system to be remotely programmed, for example for adding new products or colors to the 
database. The network card may also be used to communicate with other computers, for example 
with the computer managing or monitoring the stock of coloring products. This may be used to 
5 ensure that the most popular products selected by the user are adequately supplied, or enable to 
hold 'real time' in-store sales of slow selling product/colors. The micro-processing system may 
then be updated to display or advertise on screen "real time" promotions of those slower selling 
products. The micro-processing system may also be programmed to guide the consumer (e.g. by 
displaying a map) to a certain area of the shop where the product recommended in block 210 of 

10 the method 100 may be found (this block is discussed below). 

The likely result of the coloration as determined by the program is then displayed in the 
next step of the method, referred to as block 160 in Fig.l. Fig.6 illustrates a screen shot of a 
computer screen display that may be used in this block. In this embodiment, the likely result is 
displayed on a relatively large area of the screen 6 as a picture of a swatch of hair of the predicted 

15 resulting color. In this embodiment the likely result is selected from a pre-determined set of 
colors, which is ordered in a hierarchical list according to a visually recognizable parameter, for 
example from lighter to darker and/or tonal value. Two smaller areas set on opposite sides of the 
displayed swatch of hair are used to display colors immediately above and below the hierarchical 
level of the list (if the color displayed represents one extreme of the list, e.g. extra-light blond, 

20 then only one color may be displayed), in order to ease the navigation into the list. Optionally a 
printer may be connected to the micro-processing system and upon request a color print-out of the 
predicted color may be provided to the user. The printer may also be used for printing coupon for 
discounted purchase and reward voucher. 

If the user is satisfied by the resulting color displayed, an affirmative button (for example 

25 displaying the word "OK") on the interactive screen is provided to bring the user to a "close-out" 
or "recommendation" screen (block 170, which is illustrated on Fig.7). A "start button" is 
provided to reinitialize the method to block 110 for the next user. Alternatively, the program will 
automatically reinitialize the method to block 1 10 for the next user after a set period of inactivity. 
On the other hand, if the user is not totally satisfied or is curious about other achievable 

30 colors, the user may modify the color displayed in the result area by pressing pressure sensitive 
areas on the surface of the interactive screen having the form of buttons displaying arrows and 
short messages such as "lighter" or "darker" (as illustrated on Fig.6). By pressing these buttons 
the user proceeds to block 180 as referred to in Fig.l. In this block the user has access to all the 
achievable colors as determined by the micro-processing system from the information relating to 
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the initial hair color. The user can "scroll" or "navigate" in this list of achievable color until a 
satisfying or desired color is displayed, the smaller area displayed above and below the displayed 
swatch of hair facilitating this navigation by giving an overview of the next (lighter or darker) 
color in the list. 

5 The user then indicates to the micro-processing system that the displayed color is the 

desired color (block 190 in Fig.l) by pressing the area of the interactive screen presenting an 
affirmative message (for example the button displaying the short message "OK", as illustrated on 
the screen shot of Fig.6). With the information relating to the desired color and the information 
relating to the initial hair color, the micro-processing system extracts (block 200 in Fig.l) from 

10 the products matrixes discussed earlier one or more products capable of providing the desired 
color selected in block 190. In the following step (block 210 in Fig.l), information relating to at 
least one of the products capable of achieving the desired color as determined by the micro- 
processing system is displayed on the screen 6. The information displayed must be sufficiently 
complete for the user to identify what products, or what range of products if several products are 

15 suitable, may be used. As illustrated on Fig.7 this information may be a picture of the packaged 
product. Upon user's input, e.g. pressing a button represented on the interactive screen, the 
method is reinitialized to block 110 (containing the welcome screen) or to block 180 if the user 
wishes to try another achievable color. 

It is understood that the examples and embodiments described herein are for illustrative 

20 purposes only and that various modifications or changes in light thereof will be suggested to one 
skilled in the art without departing from the scope of the present invention. 

For example, the person skilled in the art would readily understand that method blocks 
1 10, 120 ,130 as referred to in Fig.l may be performed in any order, for example the user could 
first input the information relating to its initial hair color and then only the information relating to 

25 the coloring product. Means for reinitializing the method to the first step (e.g. block 1 10) of the 
method at any stage may also be provided. For example the method may be reinitialized to block 
1 10 by re-scanning a new pack or pressing a "start again" button on the screen at any time. Means 
for commanding the micro-processing system to go back to the previously completed step of the 
method may also be provided, for example by pressing an area of the interactive screen 

30 displaying an easily understandable message such as "back". This would allow the user to quickly 
test the result of these different inputs at each input step of the method. 

A loyalty card, smart card (RFI) chip. Compact Disc or the like may also be used as a 
marketing tool with the apparatus for carrying out the method. This would allow the consumers to 
eam points, discounts or coupons (money off next purchase) to help build customer loyalty to the 
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brand(s). The consumer may also be provided with: 

a) beauty advice and/or color tips; 

b) video or animated instructions on how to use the Product/Package; 

c) their personal coloring history - products/colors used and when; 
5 d) other related products recommended (e.g. conditioners); 

e) in the case of a computer readable medium such a Compact Disc, a link to the brand 
website. 



